Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate LongFact, a prompt set comprising thousands of questions spanning 38 topics. We then propose that LLM agents can be used as automated evaluators for longform factuality through a method which we call Search-Augmented Factuality Evaluator (SAFE). SAFE utilizes an LLM to break down a long-form response into a set of individual facts and to evaluate the accuracy of each fact using a multi-step reasoning process comprising sending search queries to Google Search and determining whether a fact is supported by the search results. Furthermore, we propose extending F1 score as an aggregated metric for long-form factuality.

US Secretary of State Marco Rubio's salvo against Chinese students, promising to "aggressively revoke" their visas, is the latest move in heightening tensions between the world's two largest economies. Despite a temporary tariff truce reached between them earlier this month, divisions between Washington and Beijing remain wide, with recent ruptures over higher education, artificial intelligence (AI) chips and rare earth minerals. Here's all we know about how relations between China and the United States are worsening despite diplomatic efforts. A US-China trade spat escalated after Trump's administration raised tariffs on Chinese goods to 145 percent earlier this year, with cumulative US duties on some Chinese goods reaching a staggering 245 percent. Under an agreement reached on May 12 following two days of trade talks in Geneva, tariffs on both sides were dropped by 115 percentage points for 90 days, during which time negotiators hope to secure a longer-term agreement.

A United Arab Emirates (UAE) academic lab today launched an artificial intelligence world model and agent, two large language models (LLMs) and a new research center in Silicon Valley as it ramps up its investment in the cutting-edge field. The UAE's Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) revealed an AI world model called PAN, which can be used to build physically realistic simulations for testing and honing the performance of AI agents. Eric Xing, President and Professor of MBZUAI and a leading AI researcher, revealed the models and lab at the Computer History Museum in Mountain View, California today. The UAE has made big investments in AI in recent years under the guidance of Sheikh Tahnoun bin Zayed al Nahyan, the nation's tech-savvy national security advisor and younger brother of president Mohamed bin Zayed Al Nahyan. Xing says the UAE's new center in Sunnyvale, California, will help the nation tap into the world's most concentrated source of AI knowledge and talent.

This week: The UK and the US agreed to the framework for a trade deal. Felix Salmon, Emily Peck, and Elizabeth Spiers discuss the details of the agreement and what it means that it includes keeping the 10% baseline tariffs staying in place. Then, Bill Gates has announced that he's winding down the Gates Foundation and doubling the money he's giving away. The hosts discuss how this is a reaction to Elon Musk's slashing of USAID and the state of billionaire philanthropy. And finally, OpenAI has reversed its plan to become a for profit enterprise after public backlash.

Tensions continue to mount as India and Pakistan traded accusations and attacks across their frontier in Kashmir overnight. New Delhi and Islamabad accused one another on Friday of launching drone attacks as well as "numerous ceasefire violations" over the Line of Control (LoC) in the disputed territory. The ongoing hostilities have provoked further calls for restraint as the risk of an escalation between the two nuclear powers grows. Pakistan launched "multiple attacks" using drones and other munitions along India's western border on Thursday night and early Friday, the Indian army said, claiming it had repelled the attacks and responded forcefully, although it did not provide details. Islamabad has denied any cross-border attacks and instead accused Indian forces of sending drones into Pakistani territory, killing at least two civilians.

Since Donald Trump launched his chaotic trade war earlier this year, it has become a truism to say he has plunged the world economy into crisis. At last month's spring meetings of the World Bank and International Monetary Fund in Washington, where policymakers and finance ministers from all over congregated, the attenders were "shellshocked", the economist Eswar Prasad, a former senior IMF official who now teaches at Cornell, told me. "The sense is that the world has changed fundamentally in ways that cannot easily be put back together. Every country has to figure out its own place in this new world order and how to protect its own interests." Trump's assault on the old global order is real. But in taking its measure, it's necessary to look beyond the daily headlines and acknowledge that being in a state of crisis is nothing new to capitalism. It's also important to note that, as Karl Marx wrote in The Eighteenth Brumaire of Louis Napoleon: "Men make their own history, but they do not make it as they please."

World economic and finance chiefs want an off-ramp from the worst global trade crisis in a century. Washington makes for a turbulent backdrop to the spring meetings of the International Monetary Fund and World Bank, headquartered in the U.S. capital as anchors of America's economic and financial clout. President Donald Trump's tariff war hasn't just roiled markets and raised recession fears: it's also called into question U.S. economic and security leadership -- a pillar of the post-World War II global order -- like never before. The stage is set for "one of the most stark and dramatic meetings I can think of in recent history," says Josh Lipsky, senior director of the GeoEconomics Center at the Atlantic Council and former IMF adviser. "You have at this moment a deep challenge to the multilateral rules-based system which the U.S. helped build."

A large-scale Russian drone attack in the southeastern Ukrainian city of Dnipro has killed three people, including a young girl, according to the regional governor, hours before officials from the United States, Europe and Ukraine gather in Paris to discuss the conflict. Dnipropetrovsk Governor Serhiy Lysak said the attacks that also injured tens of people came late on Wednesday, triggering multiple fires and damaging a dozen apartment buildings. A student residence, an educational institution and a food processing plant were also damaged, Dnipro Mayor Borys Filatov added. Photos posted online showed raging fires, burned-out vehicles and buildings with shattered windows and scorched facades, as emergency crews worked through the night. Sixteen of the injured are in hospital, one of them in critical condition, according to Lysak.

Kuala Lumpur, Malaysia – China's President Xi Jinping has arrived in Malaysia as part of a Southeast Asian tour which is seen as delivering a personal message that Beijing is a more reliable trading partner than the United States amid a bruising trade war with Washington. Xi arrived in the capital, Kuala Lumpur, on Tuesday evening in what is his first visit to Malaysia since 2013. He flew in from Vietnam where he had signed dozens of trade cooperation agreements in Hanoi on everything from artificial intelligence to rail development. On touching down, Xi said that deepening "high-level strategic cooperation" was good for the common interests of both China and Malaysia, and good for peace, stability and prosperity in the region and the world", according to the official Malaysian news agency Bernama. Xi's three-country tour and his "message" that Beijing is Southeast Asia's better friend than the truculent administration of US President Donald Trump comes as many countries in the 10-member Association of Southeast Asian Nations (ASEAN) bloc are unhappy with their treatment after the US imposed huge tariffs on countries around the world. "This is a very significant visit.

According to an SEC filing from NVIDIA, the US government now requires companies to obtain a license to export H20 integrated circuits and any other products that achieve the same performance benchmarks. The filing states that "the license requirement addresses the risk that the covered products may be used in, or diverted to, a supercomputer in China." Mainland China is not the only place targeted by this license; NVIDIA will also require permission to sell the H20 to the territories of Hong Kong and Macau as well as to nations with the D:5 designation as US Arms Embargo Countries. The H20 chips are currently the most advanced chips that can be sold to select international markets under present laws and they are powerful enough to be used for artificial intelligence applications. NVIDIA has wanted the ability to retain Chinese customers for these products and last week, it seemed like the company may have gotten a reprieve on new restrictions.